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Abstract. Benjamini, Kalai and Schramm (2001) showed that weighted ma- 
jority functions of n independent unbiased bits are uniformly stable under noise: 
when each bit is flipped with probability e, the probability that the weighted 
majority changes is at most Ce^''*. They asked what is the best possible expo- 
nent that could replace 1/4. We prove that the answer is 1/2. The upper bound 
obtained for pe is within a factor of \/7r/2 -|- o(l) from the known lower bound 
when e ^ and ne oo. 



1. Introduction 



In their study of noise sensitivity and stability of Boolean functions, Benjamini, 
Kalai and Schramm |2] showed that weighted majority functions of n independent 
unbiased itl-valued variables are uniformly stable under noise: 
when each variable is flipped with probability e, the weighted majority changes 



that could replace 1/4. In this note we prove that the answer is 1/2. Denote 
sgn(ti) = u/\u\ for M / and sgn(O) = 0, and let : ^ M" be the noise 
operator that flips each variable in its input independently with probability e. 
Formally, given a random vector X = (Xi, . . . ,Xn), the random vector Nf^[X) is 
defined as (ciiXi, . . . , OnXn) where the i.i.d. random variables cjj are independent 
of X and take the values 1,-1 with probabilities 1 — e, e respectively. 

Theorem 1.1. Let X = he a random vector uniformly distributed 

over { — 1,1}". Given nonzero weights wi, . . . ,Wn G M and a threshold t £ M, 
consider the weighted majority function f : M" { — 1,0, 1} defined by 



with probability at most Ce^/^. They asked what is the best possible exponent 



n 




(1.1) 



i=l 
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Then for e < 1/2, 

p,{n,w,t) = p[f{X) ^ /(iV,(X))) < 2e'/^ (1.2) 
Moreover, p* = limsupn^^supy^ fPe{n,w,t) satisfies 

* 

limsup^ < y2/V. (1.3) 

e^o ye 

In the statement of the theorem we opted for a simple formulation: Our proof 
yields the following sharper, but more involved estimate: 

p,(n,w,t)<^B\Bm-^\ + [l-{l-er]( '!,|)2-^ (1.4) 
m 2 \ln/2\J 

where m = [e~^J and Bm is a Binomial(m, 1/2) variable. 

It easy to see, and classical 013) that for simple majority (when all weights are 
equal) we have 

n n 

lim P(sgnyXi/sgny(A^,X)i) = -arccos(l-2e) = -V^ + 0(e2/^). (1.5) 

i=l 2=1 

For the reader's convenience we include a brief argument: 

Since Cov (^Yli=i -^i' Y17=ii^<i-^)i^ ~ '^(l ~ 2^)' central limit theorem im- 
plies that as n — > oo, 

where Z\^Z\ are standard normals with covariance 1 — 2e. We can write Z* = 
Zi cos a — Z2 sin a where Z\ , Zi are i.i.d. standard normals and a G (0, vr) satisfies 
cos a = 1 — 2e. Rotating the random vector (Zi, Z2) by the angle a yields a vector 
with first coordinate Z\. Since {Zx^Z'i) has a rotationally-symmetric law, the 
rotation changes the sign of the first coordinate with probability a/vr. This verifies 
the left-hand side of ()1.5|) : the right-hand side follows from Taylor expansion of 
cosine. 

Thus the estimate p.2p is sharp (up to the value of the constant). Moreover, the 
ratio between the upper bound in H1.3|) and the value for simple majority in ()1.5|) 
tends to Y^vr/2 < 1.26 as e 0. We remark that the stability result in theorem 
II. H is stronger than an assertion about stability of half-spaces, \x : WiXi > 9}, 
because we consider the weighted majority as taking three values, rather than two. 
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2. Proof of Theorem 11.11 

Using symmetry of Xj, we may assume that Wi > for i = l,...,n. Let 
{w,X) = Y17=i '^i-^i- We first consider the threshold t = 0. Later, we will extend 
the argument to thresholds t 7^ 0. 

We will need the following well-known fact from [3]: 

p(KX>=0)<(^J^j)2-» (2.1) 

Indeed, the collection V{w) of sets C {1, . . . n} such that X^ieD '^'i ~ ^k^D 
forms an anti-chain with respect to inclusion, so Sperner's theorem (see jj, Ch. 11) 
implies that the cardinality of T){w) is at most (|^„"2j) • Finally, observe that a vector 
X £ {—1, 1}"" satisfies = iff {i : Xj = 1} is in V{w). 

Let m = [e~^J and let r be a random variable taking the values 0, 1, . . . , m, 
with P(t = i) = e for j = 1, . . . , m and P(t = 0) = 1 — me. We use a sequence 
Ti, r2, . . . , T„ of i.i.d. random variables with the same law as r, to partition [n] = 
{1, . . . , n} into m + 1 random sets 

Aj = |i e [n] : n = j| for < j < m. (2.2) 

Denote Sj = Yli&Aj ^i-^i ^^'^ l^t Yi = Yli(^Aj '^i^i — (^)^) ~ ^i- Observe that 
Yi — Si has the same law, given X, as {w,Nf^[X)). Therefore, 



p,(n,w;,0) = P(^sgn(u;,X) /sgn(u;,iV,(X))j (2.3) 

= P(sgn(yi + 5i) /sgn(yi-Si)) . 
Denote = sgn(S'j). A key step in the proof is the pointwise identity 

l{sgn(yi + Si) / sgn(yi - Si)] (2.4) 



1 



2 • / 0} E " ^{sgn(5i + Yi) = -6} 



To verify this, we consider three cases: 

(i) Clearly both sides vanish if = 0. 

(ii) Suppose that < l^i] < |Yi| and therefore sgn(yi -|- 5i) = sgn(yi). The 
conditional distribution of 5i given Yi and |5i| is uniform over {— whence 
the conditional probability that sgn(5i -|- Yi) = —^1 is 1/2. Thus both sides of (|2.4|1 
also vanish in this case. 
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(iii) Finally, suppose that 5i / and l^ij > |Yi|. In this case sgn(S'i + 11) / — ^1, 
so both sides of (|2.4j) equal 1. 

Taking expectations in (|2.4j) and using (|2..S|) . we deduce that 

-1 . 



Pe{n,w,0) 



2E[l{5i^0}^2"Msgn(u;,X) = -6} 
^EE(^-l{sgnKX) = -e,})' 



(2.5) 



jeA 



where A = { j G [1, m] : Sj / 0}. 

The random variable i?A = #{i € A : = 1} has a Binomial(7^A, ^) distribu- 
tion given A, and satisfies the pointwise inequality 



X^io -"-{sgn 



jeA 



{sgn(ti;,X) = 



< 



2 



^ m 

+ 2l{(u;,X)=O}El{A,/0}- 



To see this, consider the three possibilities for sgn{'w,X). Taking expectations and 
using ()2.5(1 . we get 



Pe{n,w,0) < — E 



m 



2 



+ P(^i ^0)P((u;,X) =0). 



(2.6) 



Let Bi denote a Binomial(^, ^) random variable. Since for any martingale {M£}i>i 
the absolute values |M^| form a submartingale, the expression E|5£ — || is in- 
creasing in £. By averaging over A, we see that E|i?A — ^| ^ Eji?, 
conjunction with (|2.6() and (|2.1() . this implies 



- ^1 Tn 



p.(n,.,0)<lE|i..-^| + [l-(l-.)«](^^;;^jl2-« 



(2.7) 



p,(n,«;,i) = P(/(X)//(iV,(X)) 

n+l 



Next, suppose that f{x) = sgn^^^^j^ tOjXj — tj, where i / is a given thresh- 
old. Let Xn+i be a ±1 valued symmetric random variable, independent of X = 
{Xi, . . . , Xn), and define Wn+i = t. Then 

(2.8) 

= P (sgn WjXj ^ sgn['^Wi{N^X)i + Wn+iXN+i]^ , 

i=l i=l 

and the argument used above to establish the bound H2.7() for |Je(n, 0), yields the 
same bound for p^{n,w,t). This proves H1.4() . 
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To derive (|1.2)) . we may assume that e < 1/4. Use Cauchy-Schwarz to write 
E I Bm — Y I < A/Var(Sm) = y^m/A and apply the elementary inequahties 

(see, e.g., jS], Section 2.3) and [1 — (1 — e)"] < minjne, 1} < \/ne, to obtain 

Pein,w,t) <m''^/^ + ^/ne- ^/S/An-^/'^ . (2.9) 
Since m = [e"-*^] > 4/(5e) for e < 1/4, we conclude that 

Pe{n, w, t) < f 75/4 + 7374) < 2e^'^ , 



and this proves ()1.2p . 

Finally, the central limit theorem implies that 



m^oo J2-K 



00 



This proves H1.3|l . □ 
Remarks. 

1. Our proof of Theorem 11.11 was found in 1999, and was mentioned in 21. We 
present it here, with more attention to the constants, in view of the recent interest 
in related "converse" inequalities, see [3]. The randomization idea which is crucial 
to the proof was inspired by an argument of Matthews "T\ to bound cover times for 
Markov chains. See also ^Uj for related random walk estimates. 

2. After I described the proof of Theorem 11.11 to R. O'Donnell, he found (jointly 
with A. Klivans and R. Servedio) some extensions and applications of the argument 
to learning theory, see 10] for this and many other results. 

3. The proof of Theorem ll . ll extends verbatim to the case where Xi are independent 
symmetric real-valued random variables with P(Xj = 0) = for all i. However, 
this extension reduces to Theorem 1 1.1 1 bv conditioning on \Xi\. A more interesting 
extension would be to replace the symmetry assumption on Xi by the assumption 
EXi=0. 

4. Is simple majority the most noise sensitive of the weighted majority functions 
(asymptotically when e — > and ne 00) ? 

In particular, is it possible to replace the right-hand side of H1.3() by 2/tt? 
Acknowledgement. I am grateful to I. Benjamini, G. Kalai and O. Schramm for 
suggesting the problem, and to E. Mossel, R. Peled, O. Schramm, R. Siegmund- 
Schultze and H. V. Weizsacker for useful discussions. 
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